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METHOD OF FAST AUTOMATIC EXPOSURE OR GAIN CONTROL IN A MOS 

IMAGE SENSOR 

Technical Field of the Invention 

The present invention relates generally to CMOS image sensors, and more particularly, to 
a method of controlling an exposure time or gain of an image sensor. 

Background of the Invention 

Integrated circuit technology has revolutionized various fields including computers, 
control systems, telecommunications, and imaging. For example, in the imaging field, CMOS 
image sensors have proved to be less expensive to manufacture relative to CCD imaging devices. 
Further, for certain applications CMOS devices are superior in performance. The pixel elements 
in a MOS device can be made smaller and therefore provide a higher resolution than CCD image 
sensors. In addition, the signal processing logic necessary can be integrated alongside the 
imaging circuitry, thus allowing for a single integrated chip to form a complete stand alone 
imaging device. 

Examples of MOS imaging devices are detailed in "A V4 Inch Format 250K Pixel 
Amplified MOS Image Sensor Using CMOS Process" by Kawashima et al., IEDM 93-575 
(1993), and "A Low Noise Line-Amplified MOS Imaging Devices" by Ozakietal., IEEE 
Transactions on Electron Devices, Vol.38, No. 5, May 1991. In addition, U.S. Patent 
No. 5,345,266 to Denyer titled "Matrix Array Image Sensor Chip" describes a MOS image 
sensor. CMOS image sensors are now available from a variety of manufacturers, including the 
assignee of the present invention, Omni Vision Technologies, Inc. 

The primary building block of an image formed by a CMOS image sensor is a pixel. The 
number, size and spacing of the pixels determine the resolution of the image generated by the 
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imaging device. The pixels of a CMOS image sensor are semiconductor devices that transform 
incident light photons into current signals. The signal produced by each pixel is generally 
extremely small. 

One important parameter that the CMOS image sensor must be able to control is the 
5 exposure time of each pixel to incident light. Similar to light exposure time for photographic 
film, the exposure time of each pixel must be adjusted to compensate for variations in lighting 
conditions, such as for indoor or outdoor lighting. An exposure time that is too long will result 
in an image that is overly bright and washed out. In contrast, an exposure time that is too short 

pes, 

pf will result in an image that is dark and difficult to view. 

ffl Another method of varying the intensity of the pixel signals is to adjust the gain of the 

%l amplification circuitry, hi many ways, controlling the gain is substantially similar to controlling 

m 

s the exposure time. By varying one or both, the image generated by the image sensor can be 

e .. 

optimized for viewing. 

y U.S. Patent No. 5,734,426 describes one prior art method of controlling exposure time. 

f! While adequate for many applications, the speed at which the exposure time can be 
automatically changed is insufficient for certain applications. For example, for automobile 
applications, where the automobile may travel from sunlight, to darkness (such as in a tunnel), 
back to sunlight, it is important for the image sensor to be able to adjust its exposure time 
quickly. 

20 
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Brief Description of the Drawings 
In the drawings, like reference numerals refer to like parts throughout the various views 
of the non-limiting and non-exhaustive embodiments of the present invention, and wherein: 
Figure 1 is a schematic diagram of a CMOS image sensor. 
Figure 2 is a flow diagram illustrating the method of the present invention. 
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Detailed Description of the Illustrated Embodiments 
In the following description, numerous specific details are provided, such as the 
identification of various system components, to provide a thorough understanding of 
embodiments of the invention. One skilled in the art will recognize, however, that the invention 
5 can be practiced without one or more of the specific details, or with other methods, components, 
materials, etc. In still other instances, well-known structures, materials, or operations are not 
shown or described in detail to avoid obscuring aspects of various embodiments of the invention. 
Reference throughout this specification to "one embodiment" or "an embodiment" means 
n that a particular feature, structure, or characteristic described in connection with the embodiment 
5 is included in at least one embodiment of the present invention. Thus, the appearance of the 

in 

H phrases "in one embodiment" or "in an embodiment" in various places throughout this 

N 

^ specification are not necessarily all referring to the same embodiment. Furthermore, the 
particular features, structures, or characteristics may be combined in any suitable manner in one 

p 

Q or more embodiments. 

p With reference to FIGURE 1, an architecture for a CMOS imaging array 101 includes a 

rectangular matrix of pixels 103. The number of pixels in the horizontal or x-direction, and the 
number of pixels in the vertical or y-direction, constitutes the resolution of the imaging 
array 101. Each of the pixels 103 in a vertical column routes its signal to a single charge 
amplifier 105. 

20 The retrieval of information from the pixels 103 follows the well-known raster scanning 

technique. In particular, a row of pixels 103 is scanned sequentially from left to right. The next 
row is then scanned in this manner until all rows have been scanned sequentially from top to 
bottom. At the end of each complete scan of the entire array 101, a vertical blanking period of 
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predeteraiined time occurs until the raster scanning pattern is repeated. This type of scanning 
follows the NTSC scanning scheme. Control circuitry of conventional design is operative to 
sequentially read the pixels 103 in this manner. 

As each pixel is scanned, the signal from that pixel is provided to the charge 
amplifier 105 for that column. Thus, the charge amplifiers 105 receive signals sequentially. The 
sequential signals from the charge amplifiers 105 are then forwarded to a second-stage 
amplifier 107, which amplifies the signals so that they may be further processed. In various 
embodiments, either the column amplifier or the second-stage amplifier may be eliminated. 

The present invention uses the magnitudes of the amplified signals from each of the 
pixels to determine the exposure time for each pixel Generally speaking, the exposure time for 
each pixel can be varied by controlling the raster scan control algorithm. 

The method of the present invention is shown in Figure 2. While the following describes 
the method of the present invention in connection with controlling exposure time, the method 
Sj applies equally well to controlling gain. At box 201 , the magnitude of a pixel signal from a pixel 

a 

M in the array is determined. Next, at box 203, a determination is made as to whether the pixel 
signal is greater than a predetermined value VHIGH. Typically, the pixel signal will be between 
0.3 volts and 1.0 volts. This voltage level is set by the NTSC television standard. However, it 
can be appreciated that the magnitude of the pixel signal may vary depending upon the particular 
types of pixels being used, the amount of amplification in the column amplifiers or second-stage 

20 amplifiers, and various other factors. Thus, the precise voltages given herein are simply 
examples and should not be construed as limiting. 



SJ 



%'Js. 
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In one embodiment, a typical value for VHIGH is 0.8 volts. If the magnitude of the pixel 
signal is greater than VHIGH, then at box 205 a counter, NW, is incremented by 1. After 
incrementing, the next step is at box 211. 

However, if at box 203, the pixel signal is not greater than VHIGH, then, at box 207, a 
5 determination is made as to whether the pixel signal is less than another predetermined threshold 
value, VLOW. hi one embodiment, VLOW is 0.5 volts. If the pixel signal is less than VLOW, 
then at box 209, a counter, NB, is incremented by 1. After box 209, control is provided to box 
211. 

Q While the process of boxes 203, 205, 207, and 209 is being conducted for a pixel signal, 

ffl the same pixel signal is also being analyzed relative to a second set of "super" thresholds (hence 

in 

the designation "S" in the threshold names). Specifically, at box 202, a determination is made as 

N 

to whether the pixel signal is greater than a predetermined value VSHIGH. A typical value for 
VSHIGH is 0,9 volts. If the magnitude of the pixel signal is greater than VSHIGH, then at box 

%j 204 a counter, NVW, is incremented by 1 . After incrementing, the next step is at box 211. 

jj However, if at box 202, the pixel signal is not greater than VSHIGH, then, at box 206, a 

determination is made as to whether the pixel signal is less than another predetermined threshold 
value, VSLOW. In one embodiment, VSLOW is 0.4 volts. If the pixel signal is less than 
VSLOW, then at box 208, a counter, NVB, is incremented by 1. After box 208, control is 
provided to box 211. 

20 Next, at box 211, a determination is made as to whether or not any more pixels in the 

frame still need to be analyzed. If so, the process of boxes 201-209 is repeated. It should be 
noted that it is not necessary to analyze all of the pixels in a frame. Indeed, a subset of the pixels 
in the frame may be analyzed. However, in one preferred embodiment, all of the pixels are 
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analyzed. Thus, if the entire pixel array of the frame has been analyzed, then at box 213, a 
determination is made as to whether or not the counter NW is greater than a predetermined 
threshold value KW. Typically, KW is a number that is about 25% of the total number of pixels 
in the imaging array. 

5 If NW is not greater than KW, then there is no decreasing of the exposure time, and 

control goes to box 221. However, if NW is greater than KW, then there is a need to decrease 
the exposure time. Recall that the counter NW indicates the number of pixels that are exhibiting 
high output signals, corresponding to a large amount of impinging light. If a large number of 
pixels exhibit high output signals, then this indicates that there may be an overly long exposure 

ft! time. In such a case, the exposure time should be decreased. 

« fi 

iy In the prior art, after determining that NW is greater than KW, the exposure time is 

si 

01 decreased by a predetermined decrease increment. Nevertheless, if the predetermined decrease 

B 

H increment is made too small, it may take several frames of image before the exposure is 

f*s. 

adequately corrected. However, if the predetermined decrease increment is set too high, then 
fi there may be an 'overshoot" in the amount of decrease in exposure time and the video stream 
may appear "jumpy". 

In any event, in order to improve upon the prior art automatic exposure correction 
technique, in accordance with the present invention, a second step in the analysis takes place to 
determine an appropriate magnitude of the decrease to exposure time. Specifically, at box 215, a 
20 determination is made as to whether or not the counter NVW is greater than a threshold value 
KVW. If so, then at box 217, the exposure time is decreased by a first predetermined decrease 
increment. In one embodiment, the first predetermined decrease increment is defined as a 
percentage (PI) of the exposure time. However, if the counter NVW is not greater than the 
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threshold value KVW, then at box 219, the exposure time is decreased by a second 
predetermined decrease increment. In one embodiment, the second predetermined decrease 
increment is defined as a percentage (P2) of the exposure time. Typically, PI is greater than P2, 
and in one embodiment, PI is 50 percent and P2 is 6 percent. 

Thus, to summarize, if it is determined that a large number of pixels are outputting high 
signal levels (NW > KW), then the exposure time should be decreased. A next process takes 
place to determine the magnitude by which the exposure time should be decreased, PI or P2. 
For this analysis, the counter NVW (which measures the number of pixels that output a signal 
above a "super" threshold) is used. Specifically, if the counter NVW is greater than a threshold 
number KVW, then a larger decrease in the exposure time is warranted. If the counter NVW is 
not greater than KVW, then a smaller decrease in the exposure time is used. 

A similar process is followed for increasing the exposure time. Thus, if at box 213, NW 
is not greater than KW, then at box 221, a determination is made as to whether or not the counter 
NB is greater than a predetermined threshold value KB. Typically, KB is a number that is about 
75 % of the total number of pixels in the imaging array. 

If NB is not greater than KB, then there is no increasing of the exposure time. However, 
if NB is greater than KB, then there is a need to increase the exposure time. Recall that the 
counter NB indicates the number of pixels that are exhibiting low output signals, corresponding 
to a small amount of impinging light. If a large number of pixels exhibit low output signals, then 
this indicates that there may be an overly short exposure time. In such a case, the exposure time 
should be increased. 

In the prior art, after determining that NB is greater than KB, the exposure time is 
increased by a predetermined increase increment. Nevertheless, if the predetermined increase 
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increment is made too small, it may take several frames of image before the exposure is 
adequately corrected. However, if the predetermined increase increment is set too high, then 
there may be an 'overshoot" in the amount of increase in exposure time and the video stream 
may appear "jumpy". 

5 In any event, in order to improve upon the automatic exposure correction technique, in 

accordance with the present invention, a second step in the analysis takes place to determine an 
appropriate magnitude of the increase to exposure time. Specifically, at box 223, a 
determination is made as to whether or not the counter NVB is greater than a threshold value 
O KVB. If so, then at box 225, the exposure time is increased by a first predetermined increase 
f§ increment. In one embodiment, the first predetermined increase increment is defined as a 
!1 percentage (P3) of the exposure time. However, if the counter NVB is not greater than the 
threshold value KVB, then at box 227, the exposure time is increased by a second predetermined 

E 

C decrease increment. In one embodiment, the second predetermined decrease increment is 

o 

5 defined as a percentage (P4) of the exposure time. Typically, P3 is greater than P4, and m one 

Q 

fr5 embodiment, P3 is 1 00 percent and P4 is 6 percent. 

Thus, to summarize, if it is determined that a large number of pixels are outputting low 
signal levels (NB > KB), then the exposure time should be increased. A next process takes place 
to determine the magnitude by which the exposure time should be increased, P3 or P4. For this 
analysis, the counter NVB (which measures the number of pixels that output a signal below a 

20 "super" threshold) is used. Specifically, if the counter NVB is greater than a threshold number 
KVB, then a larger increase in the exposure time is warranted. If the counter NVB is not greater 
than KVB, then a smaller increase in the exposure time is used. 
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It can be appreciated that the method of Figure 2 is typically implemented on the image 
sensor integrated circuit. In particular, most image sensor chips include a sensor array and 
processor circuitry. The processor circuitry, in one example, may be programmed to perform the 
analysis detailed in Figure 2. 

While the invention is described and illustrated here in the context of a limited number of 
embodiments, the invention may be embodied in many forms without departing from the spirit of 
the essential characteristics of the invention. The illustrated and described embodiments are 
therefore to be considered in all respects as illustrative and not restrictive. For example, the 
above detailed description has been given in terms of adjusting the exposure time. However, the 
techniques described above apply equally to gain control. For example, instead of increasing or 
decreasing the amount of exposure, the amount of gain can be similarly increased or decreased. 
Still further, both the exposure time and gain can be increased or decreased as the need may be. 
Thus, the scope of the invention is indicated by the appended claims rather than by the foregoing 
description, and all changes which come within the meaning and range of equivalency of the 
claims are intended to be embraced therein. 
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